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RATES FOR BRANCHING PARTICLE APPROXIMATIONS 
OF CONTINUOUS-DISCRETE FILTERS 

By Michael A. Kouritzin and Wei Sun 

University of Alberta and Concordia University 

Herein, we analyze an efficient branching particle method for 
asymptotic solutions to a class of continuous-discrete filtering prob- 
lems. Suppose that t — > Xt is a Markov process and we wish to calcu- 
late the measure- valued process t — > j-it(-) = P{X t € -\o~{Yt k , tk < t}}, 
where tk = he and It,, is a distorted, corrupted, partial observation 
of Xt fc . Then, one constructs a particle system with observation- 
dependent branching and n initial particles whose empirical measure 
at time t, n", closely approximates \xt- Each particle evolves inde- 
pendently of the other particles according to the law of the signal 
between observation times tk, and branches with small probability 
at an observation time. For filtering problems where s is very small, 
using the algorithm considered in this paper requires far fewer com- 
putations than other algorithms that branch or interact all particles 
regardless of the value of e. We analyze the algorithm on Levy-stable 
signals and give rates of convergence for £ 1/,2 {||/i" — /i t || 2 }, where 
|| ■ || 7 is a Sobolev norm, as well as related convergence results. 

1. Introduction. The filtering problems in many key, contemporary fields 
such as mathematical finance and communication networks initially appear 
to be resolved by the celebrated mathematical solutions of the Duncan- 
Mortensen-Zakai and Kushner-Stratonovich equations, which have been 
known for over three decades. However, upon further reflection, one real- 
izes that these equations are neither computer workable nor applicable at 
large. More theory is required keeping: (a) the ultimate computer enduse, 
and (b) some real world applications in mind. Many of the corresponding 
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filtering problems are large enough that the mere storage of the exact so- 
lutions is impractical. We require more implementable, practical methods 
of filtering, where the solutions are almost optimal and can be stored. The 
introduction of particle approximations is natural under these criteria. 

The general problem of continuous-discrete filtering for Markov processes 
is concerned with extracting information about a continuous-time Markov 
process t—*Xt called the signal based on the current record of discrete-time 
observations {Yt k , <t} that are probabilistically linked to the signal. The 
goal of filtering is to estimate past, present or future values of <p(X t ) based 
on our observation record {Yt k , t^ < t}. Direct implementation of the math- 
ematical solution to these filtering problems usually requires the on-line 
solution of an infinite-dimensional (often parabolic) equation (see, however, 
[11] for counter examples where such infinite-dimensional equation solution 
is not required), which is impossible to either implement precisely or store. 
For these reasons, one may be forced to approximate. One exciting method of 
approximation for continuous-discrete filtering problems was recently stud- 
ied by Del Moral and collaborators (see [7] for one of the earlier works), 
where, instead of solving a parabolic equation on-line, one simulates parti- 
cles so that the empirical measure of the particles is a good approximation to 
the solution of the differential equation. Then, to account for the incoming 
observations, one allows the particles to redistribute themselves to locations 
favored by the observations. This second branching or interacting step is 
devised to ensure that new information obtained through the observations 
can be incorporated into our conditional probability law of the signal given 
the observation record. A thorough account of this interesting interacting 
particle method can be found in [9]. 

More recently, algorithms have been considered in [1] and [8] that do 
not disturb most particles at each observation time and thereby introduce far 
less resampling noise. Indeed, the huge performance gained by only resam- 
pling those particles that need to be resampled was quantified experimentally 
in the former paper and theoretically in the latter. Herein, we further de- 
velop and study the cautious branching particle approach in [1], which was 
motivated in part by the particle system approximation scheme suggested 
by Sherman and Peskin [17] for the deterministic reaction-diffusion equa- 
tions and by the earlier branching particle method of Crisan and Lyons [6]. 
To make our presentation clear, we choose to introduce and analyze our 
method on Levy-stable signal processes, however, this particle approxima- 
tion method is extendable well beyond our current setting as experiments 
have demonstrated. 

Levy-stable processes are one of the most basic and important classes of 
Markov processes. They are widely used in various economic and physical 
systems. In particular, the use of Levy-stable processes in mathematical 
finance and communication networks has recently become more popular. 



RATES FOR PARTICLE APPROXIMATIONS OF FILTERS 



3 



For instance, Levy-stable models have been applied in the fields of portfolio 
theory, asset and option pricing (cf. [3, 14] and the references therein); and 
Levy-stable processes have been used to model teletraffic and to approximate 
network traffic (cf. [10, 15]). These vital applications are motivation for us 
to analyze our method on Levy-stable signals. 

We let (Q,,J-,P°) be a complete probability space and E° be the expecta- 
tion with respect to P°. Suppose that X is a M. dl -valued Levy-stable process 
on (Q,J-,P°) with index a € (0,2] and spectral measure T (cf. [16]), that is, 
X is a stochastic process on R rfl such that X has independent increments, 
and there exists a finite measure V on the unit sphere of R^ 1 such that, 
for any 6 = (6>i, . . . , dl )' € R dl and < s < t < oo, 

lnE°{exp{iO'(X t -X s ))} 

{-(t-s)J \e'z\ a (l-isiga{e / z)tan(^jjT(dz), fora/1, 
-(t-s)J |0^1 + ^sign(0'z)ln|0^r(d;z), fora=l. 

Hereafter, we use " ' " to denote the transpose of a vector. We let < £ < 1, 
define t^ = ke for k = 1,2,..., and suppose that V is a standard Re- 
valued Brownian motion on (f2,.F, P ) independent of X. Then, we consider 
calculating the conditional probability law of signal Xf given the multi- 
dimensional observations {Yt k , <t}, defined by 

Y tk = Yt k . x + h(X tk )(t k - i fc _x) + (V tk - Vt fe _J, 

via change of measure and particle approximation. 

Our particle approximation scheme can be summarized as follows: We 
consider a branching particle system which starts off with n particles and 
each particle has the "opportunity" to branch and die every e seconds. A 
particle reaching x at time t/-— branches with small probability and in this 
unlikely event that the particle does branch, it either just dies or is replaced 
by two or more independent particles starting at (tk,x). Efficiencies are 
gained at observation times in two ways: The vast majority of particles 
do not branch at branching times for small e, which reduces computation 
related to duplicating or removing particles, and branching decisions only 
depend on the very particle that may or may not branch so decisions require 
little processing. On the other hand, the number of particles in our scheme 
does not stay constant, but rather is a nontrivial martingale. Still, there are 
effective ways to control the number of particles in practice, by introducing 
additional births and deaths that do not bias estimates, and thereby to keep 
the computations essentially constant over the various observation times. 
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Suppose that 5 X denotes the Dirac delta measure at x and 

1 \m 

(i) = - E 

is the empirical measure of the particle system if there are ||//"|| particles 

{xl>\...,xt< 

will imply that 



{X^,...,^!^ 11 '"} alive at time t. Then, among other things, our results 



(2) 



tf&fij Li ^ x )^(dx)-E°{ i p(X t )\{Y tk ,t k <t}} 







in probability, as e — > 0, n — > oo, with a rate of convergence for all continuous 
bounded ip so long as inf^le 1 / 2 !}} > 0. Indeed, we establish much more in 
terms of estimates on the error in (2) and types of convergence, including 
2nd-mean and almost sure. 

2. Notation, results and algorithm. In the current section we set our 
main notation, state our results and give our particle system algorithm to 
asymptotically solve our filtering problem. The proofs of the stated results 
are given in a later section. During the course of a proof we use the same 
symbol c for constants, although the exact value of the constant may change. 
We show the dependence of c on relevant parameters unless suppression 
causes no confusion. Throughout this note, we take | - 1 to be both Euclidean 
distance, as well as absolute value (depending on context). We fix a constant 
T > and let < s < 1. To conserve space, we define 

(A,¥>) = / j <p(x)\{dx) 

for all signed Borel measures A and |A|-integrable functions (p. Next, we 
let ^(IR^ 1 ) denote the set of all measurable bounded functions on R dl . For 
if € £>b(M dl ), we let ||y||oo denote its supremum norm. We denote by C the 
generator of the signal X , and define 

T = {tpe B b (R dl ):C^ G B b (R dl )}. 

Then, one can check that T contains all finite multivariate trigonometric 
series. Further, we let 5(ffi dl ) denote the set of all rapidly decreasing func- 
tions on IR^ 1 and assume that h = (hi, . . . , hd 2 )' with hi € 5(]R a!l ) for each 
1 < i < d>2- Finally, we let [^J denote the greatest integer not more than a 
real number u, let \u\ denote the least integer not less than u, and adopt 
the convention that a product over zero or a negative number of elements is 
one. 

We define filtration 

y = cr{y tfc ,t fc <t}VAA 
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for the observations Y, where Af is the collection of P°-null sets of (Q, J-). 
Motivated by the reference probability measure method for filtering, we 
define a new probability measure via 

dP 

VT, 



dP° 

where 

(3) Vt = 11 exp (Xt k )(Vt k - Vt^J - 1 

for < t < T. We define X 1 = a{X s ,0 <s<t}\/AT and find that {rjt , t € 
[0,T]} is an {X T V 3^'}o<t<r-martingale with respect to P°. Under P, {Y tk — 
Yt k _ 1 ,k = 1,2,..., [T/eJ} is a sequence of N(0,eld 2 ) random vectors inde- 
pendent of X and the law of X remains unchanged. Yet, by (3), it follows 
that 



fc=l 

We let £" be the expectation with respect to P and define 

{ f i t ,<p) = E{< P (x t )^ 1 \y t } 

for < t < T. Then, it follows from Bayes' rule that, for any ip £ £>&(IR rfl ), 



m ;| 1 1^} 



M 

by the <Y T V ^-martingale property of rj^ 1 with respect to P. For the pro- 
cesses that we will work with later, one may always assume that X is cadlag 
and, hence, that fit is also (cf. [19]). We always work with this cadlag version. 

First, considering the optimal solution to the filtering problem, we have 
the following lemma whose proof is sketched in the Appendix. 

Lemma 1. Suppose that fio is the distribution of the initial signal state. 
Then, {fJ<t,t>0} is the unique measure-valued, {y t }t>o-progressive process 
satisfying 

{fJ, t ,<p) = (PcV 3 ) + / (HsX^ds 
Jo 
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(4) + L f( fe -.9(ex P {(y„ -Y tk _jh- fa-^-)"'" } _ i)) 
/or aZZ if € T. 

Moving to our particle approximation, we recall that and /x" denote, 
respectively, the number of particles alive and the empirical measure for the 

|| . n II 

particles as in the Introduction. Once we have particles {Xl' n } i= \ ,t > 0, 
we can form our approximation to fit via empirical measure (1). Therefore, 
our pressing need is to find a good generation method for the particles. 
We suggest using the algorithm below to produce particles whose empirical 
measure is shown in the sequel to converge nicely to {nt,t > 0}. 
To ease the notation in what follows, we define 

(5) - ^,««) - -'<-■>("'">(*> 
and 

oo 

DY t %x) = J2he(t)QUx) 



k=l 



g e k (x), ifp|(x)<0, 
&%( x ) ~ \_6%(, x )\-> otherwise. 

Moreover, due to the fact that we have both continuous and discrete com- 
ponents to our systems, it will be convenient in the sequel to interpret She 
in two ways: 

1, if ke G (s, u], 
0, otherwise, 



S ke (t)dt 



and 

l 



x, r^-/ 1 ' Hk€{i,i + l,...,l}, 
4-i teU;_ l0, otherwise. 



3=i 



Next, we let {/9*}" =1 be n independent M rfl -valued random variables with 
the distribution /j,q, let {X t }'^L 1 be a sequence of independent M. dl -valued 
Levy-stable processes with index a and spectral measure V, let {U l,k }°° k=l 
be a sequence of independent uniform random variables on [0, 1] . We suppose 
that {/3*}f =1 , {X t } c *L 1 and {U l,k }°° k=1 are defined on the same probability 
space (fl* ,J-* ,P*) and they are independent of one another. We define the 
product probability space (ft, T, P) = (Q ® O*, T ® T* , P° ® P*) and let £ 
be the expectation with respect to P. Then, to construct our particle system 
to approximate [it, we do the following: 
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1. Let H/Uq || = n and Xq 71 = p l for i = 1, . . . , ||/iQ || (* Assign initial particle 
locations*). 

2. For k = 1,2, ... , do the following: 

(a) Set Xl' n = Xl'^ + (X\- Xt^ ) for t £ [t fc _i,* fc ) and i 6 {1, . . . , ||} 
(*Evolve particles as signal*). 

(b) Fbrt = l ) ... ) ||/^_ 1 ||, do 

(i) If Q%(X^ } ) > (*Branch*), 

(A) Replace particle X\^_ with m = [_Q%(Xl^_)\ + 1 particles x[ % ^ ,n . 

v (i,m),n . v i,n 

...,Xl k atsiteX t ;_, 

(B) Add 1 more particle X^ m+1) ' n at site X l t ' n _ if IP* < Q £ k {X l t ' n _)- 

(ii) Otherwise, 

(A) Make no change if 17*'* > \q%(x\^_)\, 

(B) Kill if IP* < \q%{X^_)\ (*Particle will just be removed*). 

3. Relabel the alive particles to be {Xl'™} i= ^ so that ||//f fc || is the number 
of particles alive. 

Our main contributions can be considered as the popularization of this al- 
gorithm and its analysis. As we already mentioned, U %,k < |£|(A^"_)|, hence, 
branching or killing will seldom occur at a particular observation for small 
e > 0. In preparation to listing our main analytic results, we wish now to 
assert that our empirical measures or particle density profiles 

1 \m 

$ = - E 6 xr 

i=i 

do henceforth pertain only to the particles {^t' n }|=i , t>0, generated by 
this algorithm. We define new nitrations {^*}t>0j {£/*}t>o to keep track of 
current information in our empirical measures and our whole particle system 
construction via 

P t =f]a{xi' n ,i = i,...,\\^\\,s<t + 5}yy t , 

8>0 

g t =f)a{Xl> n ,i = l,...,\\^\\,s<t + 6} 

8>o 

vy T Va{U i < k ,t k <t,i = l,2,...}. 

Further, we interpret our particle system approximation as a (purely atomic) 
measure- valued cadlag process through the stochastic equation (6) in Propo- 
sition 2. Hereafter, for a semimartingale Z, we use [Z] = {[Z,Z]t,t > 0} to 
denote its quadratic variation process. 
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Proposition 2. Suppose that {fJ.f,t > 0} is the particle density profile 
constructed by the preceding algorithm. Then 



(6) 

[t/ej 

fe=i 

/or aZ/ </? € T, where {.A4™(^)}t>o is a cddldg {G t }t>o -martingale. We define 
E u to be the expectation taken only with respect to the {U l,k }. Then 

[t/ei IK II 



(7) 



k=0 i=l 



L*AJ 



^X>L-,(itfi-(«)V>- 



fe=i 



Moreover, we have that 

[t/s] 



E< 



(8) 



fc=|_s/e|+l 

r/2 

^cwdi^'ftiioovir/ 2 ' 



[i/ej 

E /- 

k=[s/e\+l 



A/2 



sup £;{«,i) r } iiy 



n' \o<t<t 



2r 

oo 



/or any {fk}kLi CR, 0<s<t<T, where r > 2 and c(r) > is a constant 
independent of d\, di, £, n, t, s, (p. 

This representation lemma differs from standard formulations because it 
contains both continuous and discrete time components. It is possible to 
come up with a more complete martingale problem description by consid- 
ering more general functionals F((fj,^,(p)) instead of just (/i™,^). However, 
our representation is sufficient for our purposes. To prove Proposition 2, we 
need the following Lemma 3. The proofs of Lemma 3 and Proposition 2 are 
given in the Appendix. 

Lemma 3. Suppose r > 1. Then, there is a constant c(r) > independent 
of d\, di, £, x, k such that 

EM(x)\ r }<c(r)\\h'h\\^e r / 2 

for allxeR dl and k = 1,2, ... . 
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By Lemma 1, {fj^, t > 0} is the unique measure- valued, {3^}t>crP r ogressive 
process such that 

rt 



(9) ((H,<p) = (Vo,<p) + / (fJ-s-,B £ s ip)ds 

Jo 

for all ip G T, where 

(10) B £ s ip = Ccp + DY s £ cp. 

Note, here and in the sequel, integrals like /q (// s _, 5f</>) (is should be inter- 
preted in the Lebesgue-Stieltjes sense, including jumps at t but not at 
(owing to the fact that DY£ is a purely atomic measure and not a function). 
We let 7 < —di/2 and define 



IAI 



|A(0)| 2 7 (d0), j(de) = (i + \e\ 2 rde, 



\(6) = (\,e- e ), 



e-e{x) 



where A denotes the Fourier-Stieltjes transform for a signed measure A. In 
the sequel, we use |M|l2( 7 ), ||<^||l2, respectively, to denote the L 2 -norm of 
a function <p in L 2 (R d i; 7 (d0)), L 2 (R dl ; d9) . We denote ||r|| = T(S dl ). For 
m £ N, we define 



(11) 



sup < 

l<i<d2,\T\<m 



n < 

a<j<di 



|xj| + l) L> T /i 4 



where r = (r±, . . . ,t^) with Tj E Z + is a multi-index, |r| = J2jLi T j an d £> T = 

d\ T \/(dx?---dx£). 

Now, we can state our main results. 

Theorem 4. Let {/i™ , t > 0} 6e our particle density profile as described 
above. Suppose 7 < — (d\/2 + 2a). 

(i) Let H>0 be a constant. Then, there is a constant c(3, di, a, \\T\\, 
hdi-2rA+2iT) >0 independent of e, n, t, s such that 

c(E,di,a, ||r||,((/t))[ dl _ 27 ] + 2,r) 



< 



(12) 



£ l/8 n l/2 

xUt-sf^ + it-s) 



+ e 



1/2, 



( 


t 




s 


) - V4 ( 






S 






_e_ 




_e_ 






_e_ 





V0<s<t<T 
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for any < e < 1 and n € N satisfying e l l 2 n > S. 

(ii) (Rate of convergence.) Let < e < 1 be a constant. Then, there is a 
constant c(e,di,a, ||r||, ((fr))w 1 _27]+2>^') >0 independent of n such that 

n o\ £.1/2/11 n 112, ^ c (g^l ; «Jl r IUW)[di-2 7 ]+2^) 

(13) sup E {Wnt - /it 7 }< j-^ ■ 

for all n G N. 

Corollary 5. Lei > 0} 6e our particle density profile as described 
above. Suppose that a = 2 and 7 < —(d\/2 + 4). 

(i) Lei H > and (3 > 1/8 6e too constants. Then, there is a constant 
c(5,di,/3, ||r||, ((/i))[d 1 _2 7 ]+2> ^) > independent of e, n such that 

e^\ sup ||(a£-^)-(a£-aOII?} 

(14) 

c(5,di,A l|r||, ((/t)) [dl _ 27 ] +2 ,r) 

£ /3 n l/2 

/or any < e < 1 and re € N satisfying e 1 / 2 ^ > S. 

(ii) (Rate of convergence.) Let < e < 1 &e a constant. Then, there is a 
constant c(e,di, \\T\\, ((h))[ dl _ 2 ~ f ]j r 2,T) >0 independent of re suc/i i/iat 

(15) E' I sup /i?-/xt \< * 

for all n G N. 

Remark 6. For the interacting mechanism chosen in the work of Del 
Moral [7], the number of particles remains constant and particles redis- 
tribute themselves around existing particle sites according to a multinomial 
distribution at observation times. Specifically, suppose {X t , . . . , X™'™} de- 
notes the n particle locations used to approximate the filtering problem 
solution just prior to {Wl' n , . . . , W£' n } are the normalized weights for 
the particles, and {X t ^ n , . . . , X™' } is the system immediately following the 
interaction. Then, the Xl'^'s are obtained from the X$' f s by having each 
X\'™ choose starting location X\'™_ with probability W^ n independent of all 
other particle decisions. Each weight W^ ,n is a function of all the previous 
generation particles {X t f^ , . . . , X^f^_ } , the current observation Y tk , the con- 
ditional distribution of the observation given the current signal state Xt k , 
and the conditional distribution of signal Xt k given all the previous obser- 
vations {Y tj ,j < k}. Clearly, £j=i Wfc'™ = 1 and the event {X^ ^ X l t ' k n _} 
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has probability 1 — Wl' n (uj), so the expected number of branches or jumps 
created at an observation time is n — 1 even when the observation interval 
or the time between jumps is very small. Moreover, as mentioned in [5], the 
decision of where each particle will jump to requires sampling all particles, 
and the overall result is that a large amount of computational work must be 
done at observation times. 

Remark 7. In [4] rates of convergence for a branching particle approxi- 
mation to the solution of the Zakai equation are deduced. For a class of test 
functions, exact rates of convergence are established for the filtering model 
with diffusion signal and continuous observations. The analysis in [4] hinges 
on a powerful representation formula of the variance of the branching mech- 
anism in terms of the local time of an exponential martingale, which is quite 
different from the analysis in this paper. Throughout this paper Fourier 
analysis is used, which enables us to obtain powerful rates of convergence in 
Sobolev norms. (We refer the interested reader to [2] and references therein 
for some other works via Fourier analysis, which are close in spirit to our 
approach.) The analysis of the existing interacting and branching methods 
for continuous-discrete filters is rather complicated, as is evidenced by the 
limited number of existing estimates especially involving the time intervals 
between observations. As suggested in [4], the continuous observation time 
set-up makes the branching method converge slower. Our Theorem 4 and 
Corollary 5 reveal the subtle relationship between the number of initial parti- 
cles and the length of the time intervals between observations. In particular, 
the convergence of the algorithm is ensured if m.i £ ^ n {e 1 ^ 2 n\ > 0. In a forth- 
coming work, we look forward to further developing the spectral method in 
this paper to obtain rates of convergence for more general (not necessary 
diffusion) Markov processes and other recently developed particle filters. 

3. Proofs of Theorem 4 and Corollary 5. 

3.1. Auxiliary results used to establish Theorem 4 and Corollary 5. 

Lemma 8. Let Z be a M. dl -valued Levy-stable process on (&,J-, P) with 
index a £ (0,2] and spectral measure V. We define Z t {9) = e_#(Z t ) and 
||[Z(0)] t || = [ReZ(6)]t+ [lmZ{9)} t , V# € R dl , t > 0. Then, for0<s<t<oo, 

(16) E{\\[Z(e)] t \\-\\[Z(9)] s \\} = 2(t- S ) f \e'z\ a T(dz). 

Suppose r > 1. Then, there is a constant c(r) > such that, for any < s < 
t < oo, 

E{(\\[Z(0)]t\\-\\[Z(0)]s\\Y} 



12 

(17) 
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< (r)(t " s ){ \0'z\ a T(dz^j V \e'z\ a T(dz) 

Moreover, if a = 2, then 
(18) 



\\[Z(9)] t \\-\\[Z(B)] \\ = 2t \e'z\ 2 F(dz). 

Js dl 



Proof. For < s < t < oo, we let {tJ 1 , j = 0, 1, . . . , & m }~ =1 be a refining 
sequence of partitions for [s, t] with s = r™ < rj 71 < • • • < r|™ = t and define 



< t = Ei%w-%^)i 2 ' 

i=i 

Then, we find by direct calculation that 

E{\\[Z(e)] t \\-\\[Z(9)] s \\} 
= lim E{ir™} 

{km 
E(2 - {e_ e (Z T ™ - ZrmJ + e e (Z T ™ - Z T ™ J}) 



lim < 



^2 1-exp -(rf -r-J / |^rr(d; 

i=l V L JS 'd 1 

x cos((rf - r™!) / |^| Q sign(^ 

xtan(^r(cte))), 

E2(l-exp|-(rf-r- 1 )^ |^|r(cfe)} 

x cos f (r, m - r£\) / -\0'z\ sign(0'z) 
\ J J JSd, n 



for a 7^ 1, 



x ln|0';z|r(dz)) , 



for a = 1 



2(t-s) / |^| Q r(dz). 
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By (16), to prove (17), we may assume without loss of generality that r 6 
By the independence of the increments of Z, we find that 

E{(\\[Z(e)]t\\-\\[Z(9)]s\\Y} 
= lim £{(vr™) r } 

(19) = 5( Jm^{ (£(2 - {e-e{Z T? - Z Tf _ x ) + e e (Z rT - Z^)})^ j 



lim 



E 



\ s,ti \- akm =r 



x [] E{{2 - {e_,(Z rr - Z TT J + e e (Z T? - Z^)})^}. 



Note that, for ay > 1, 1 < j < k m , 
E{(2 - {e_e(Z rr - Z T? _ x ) + ee (Z Tr - Z^)})^'} 



(20) 



xE 

g=0 



ex P {-(rf-r-0 



|(2g + Z-a i )(9 / z| 



x < 



x M -isign((2q + l-aj)6'z) 

x tan ^-^r(cfe) j 

for a y^l, 

f \{2q + l-a j )9 l z\ 



2i 



x H sign((2gr + I - aij)0'z) 



7T 



xln\6'z\ )T(dz) 

for a = 1 
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E{(?)2'(-1) £ 

Eff a V z )(-r--r-i) 

J s \{2q + l- a 3 )9'z\ a T(dz)^ 1 + 0((rf - rjl x ) 5 



x 

9=0 



< c(r)(rf - rjlj / |0'.z| a r(dz) + 0((rf - r™ i) 2 ). 
Thus, by(19) and (20), we find that 

E{(\\[z(e)]t\\-\\[z(e)]s\\) r } 



< lim > 

v s,t; ai -| ^ Qfem=r \ i 

x II (^(Tf-T^) / \e'z\ a T(dz) 

+ 0((r™-rf„ 1 ) 2 )) 

< c(r)(t " s ){ l^rr(de)^ V Qf \d'z\ a T(dz) 
If a = 2, then we find by the independence of the increments of Z that 

fi{(||[2(0)],||-||[ZM]ol|-2i |<^| 2 r(<fe)) 2 } 

x/ s j^pr ((i2 )})) 2 } 

^4%SM( 2exp {- (T "- T ™' , 4 |fc|2r " i2) } 
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m 

6{n! 



lim Vf4exp(-2(r, m -T™ 1 ) / \9'z\ 2 T{dz) 
t^)-0^\ I 3 3 Js dl 

- 8exp(-2(rf - rf_ x ) f \9'z\ 2 T(d 

+ 2 (l + exp{-4(rf - t™_ x ) jf |0'z| 2 r((fc) 
= 0. 

Therefore, (18) follows. □ 

Lemma 9. Suppose that r > 1 and H > is a constant. Then, there is 
a constant c(r, H, T) > independent of d\, di, s, n such that the empirical 
measure of our particle system satisfies 

sup #/ r {<^, l) r } < c(r, 3, TXII/AHso V If 

0<t<T 

/or any < e < 1 and n € N satisfying e l / 2 n > S. 

Proof. By (6), (59) in the Appendix, Lemma 3 and induction, one finds 
that sup 0<t< j. £{(^\l) r }<oo. We define 

(2i) a= iai - ca) 2 - 

From (6)-(8) with tp = l, noting that {E^ii" 1 (/-$£-> 0f)}f>o is an {J^_}<> - 
martingale and using Burkholder's inequality, independence, Jensen's in- 
equality, Lemma 3, Minkowski's integral inequality and (21), we find that 

£{</4U> r } 

'L*/*J 



< c(r)|^{(^, 1)'} + ^{ ( E } 



+ (E{\E u {[M n (l)] t }\ r/2 } + E{\[M n (l)] t - E u {[M n (l)] t }\ r/2 }) 

[t/e] 



c(r)|l + ^E^te-'^)) } 

+ (^{(| J (^-,a)) r/2 } 



+ E{\[M n (l)] t - E u '{[M n (l)] t }\ r/2 } 
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(r/2)-l LVeJ 

\\tih\\%*e^Y,H(^-i )E ,m 

k=\ 



{■* 








_e_ 



+ 



(r/2)-l r/4 

sup ^{(^,l) r / 2 } 



r/2 

+ (Halloo vi) r / 2 



n''~ o< s <t 

t 

£ 



r/4 1/2 "I 

sup £{K,i) r/2 } , 



n r / 2 o<s<r 

where we have assumed without loss of generality that r > 4 above. Applying 
the discrete version of Gronwall's inequality, one thus discovers that 

sup in 

0<t<T 

< c (r,T)(||/^|| 00 vWl + T ^ sup E{(tf,l) r / 2 }) 

V e r l^n r l l <t<T J 

< c(r, T)(\WhU V l) r/2 (l + ^sup^Otf, 

Therefore, 

sup E{(tf,l) r } 

0<t<T 



< 



'cfaTXWh'hWnViyVe 1 / 2 

£ r/A n r/2 



2 



<c(r,2,r)(||/!'/!|| M Vl) r 
for any < e < 1 and n € N satisfying e l l 2 n > S. □ 

The following maximal inequality is a consequence of a theorem of Long- 
necker and Serfling [13] (cf. also [12]) and is used in (14) above. 

Lemma 10. Let < U\ < U-z < oo and suppose that {Q t , U\<t < U2} is 
a process assuming values in some normed vector space (Z, \\ ■ ||) with the 
following conditions: (i) t — ► Qi(cj) is right continuous on [Ui, U2] for almost 
all 00, (ii) There exist constants [i > 1 and v > swc/i i/ia£ £7{||Qt — Qsll"} < 
(h(s,t))^ for all U\ < s < t < U2, where h(t,s) is a nonnegative function 
satisfying h(s,t) + h(t,u) < h(s,u) for all U\ < s < t < u < 1/2- Then, there 
exists a constant A^ v depending only upon [i, v such that 

e{ sup \\Qt-Qs\\ u )<A^(h(U u U2)Y. 

VU 1 <s<t<U 2 J 
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Proof. Let {t\,i = 0,l,-.-,i r n}]*L 1 be a refining sequence of partitions 
for [Ui, U 2 ] with U\ = t l < t[ < ■ ■ ■ < t\ H = U 2 and define 



T k = Qt\ - Qt 



9l(i,j) =M4'*i-i) Vi,j,ke {l,...,n t },i<j. 



Then, we can apply Theorem 1 of [13] to find that there is a constant An u 
depending only upon //, v such that 



e{ sup \\Q i} -Q tl f\ = E\ 





"1 


t r{ 




k=i+l 





3 








k=l 





sup 

<i<j<n t 



< 2 U sup 

\l<i<ni 

= A^(h(U 1 ,U 2 )f. 

The lemma therefore follows from monotone convergence and the observa- 
tion that right continuity guarantees that 



sup \\Q t i - Q t i 



l— >oo 



t/l<t'<t'.<t/2 



sup \\Qt-Qs 

Ui<s<t<U 2 



□ 



3.2. Proof of Theorem 4. Recalling (5), (6), (9) and (10), we find that 
fi n — \x satisfies 

(t% - m, <p) = (JJ% ~ Mo, <p)+ [ - Vs-,B £ s <p) ds + M n t {ip) 

Jo 

for all ip £ T, where A4™((p) is the martingale of Proposition 2. We define 



y |6»'z| a ^l + isign(6»'z)tan^ 
/ \0 , z\(l-—sign(e'z)ln\6'z\)T(dz 



T(dz), 



for 
for a = 1. 



Then, using </? = e_#, we find that 

f 

lo 



(22) 



+ 



e_ + L>y/e_ e )efe + A^(0) 

V#eM dl . 
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Hereafter, to ease the notation, we let J\4f(6) = At"(e_e). We define 
\\[M n (e)] t \\ = [ReM n (e)}t + [lmM n (e)} t , 

||[#' B (0)]t|| = [ReX^mt + [ImJT> n (0)] t! Xi' n {9) = e. e (X^ n ). 

Then, from Proposition 2 and (21), we find that {.M"(0)}t>o is a complex 
martingale with 

1 LtAjK" 



£ a {||[^ n (0)W} = ^£ E (II^WWiAtll ll[** ,B »JI) 

(23) 



n k=0 i=l 



l [t/e 



n k =i 

Next, we divide — /zt,e_e) into components: 
Here, we define 

(24) u»(0) = f l{6)u n Mds + M r i{e), 

Jo 

(25) xrw = (xr,e_ e ) 

with 

(26) (X?^) = (^-M0^}+ f\x n s _,B^)ds V^eT, 

Jo 

and 

(27) #(0) = - Mt, - fi?(0) - 

Note that, in the above definition, x" is just the unnormalized filtering 
process fit with the initial distribution /x™ — fiQ. We define 

A 1 = E 1 / 2 {\\u--u-\\ 2 L2(7) }, 
A 2 = E 1 / 2 {\\v--v-\\l 2{7) }, 

A,=E^{\\^-r s \\h {1) }- 

Then, 

(28) E l ' 2 { || - Mt ) - (/i- - fi,) \\ 2 } < A x + A 2 + A 3 

by Minkowski's inequality. In the following, we will estimate A%, 1 < i < 3, 
one by one. 

(a) Estimation of A±. 
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One finds from Proposition 2 that the following Wiener integral makes 
sense and from (24), as well as integration by parts, that 

(29) i%{9)= f e-K V {{t-s)l{9)}dM n s (e). 



o 



Fixing a r > 2, one finds from (29) that, for < s < t < T, 
E{K(0)-u n M\ 2r } 

(exp{(i - s)£{9)} - l)u n s {9) + _£exp{(i - t)£{9)} dM n T {9) 

Yet, using Burkholder's inequality, we find that 

E{\uno)-u^e)\ 2r } 

<c(r)||exp{(t-s)^)}-l| 2r 

xE{( f exp(-2(s-r) 
(30) lU ° 1 

\9'z\°T(dz)}d\\[M n (9)} T \f) | 
+ J E|^*exp|-2(t-r) 

\e'z\ a r(dz)^d\\[M n (e)] T \\J^y 

We define 

n k=0 i=i v H * 

and 

i lr/s\\K-W 



n k=l i=l 

x (sign(^(x4 n _))l {[/i , fce[0i|e|(x ^_ )|)} - el(^T-))- 

Then, A4™ ,e (9) and .A4™ ,6 (#) are, respectively, the evolving and branching 
portions of the martingale M™(9). Considering (23) and separating Uf(9) 
into parts driven by Ai™ ,e (9) and A4™ ,b (9), we find from double use of 
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Holder's inequality and Lemma 8 that the evolving part of (30) satisfies 

< c(r)(|exp{(t - s)£(6)} - l\ 2r E{\\[M n ' e (9)] s \\ r } 



' exp<{ -4r(t - r) \9' z\ a T{dz)\ d\\[M n ' e {9)] T \ 



x{E{{\\[M n ' e {9)] t \\-\\[M n 



'Ml)"- 1 }) 1 / 2 



1/2 



1/r 



< 



c(r, 



n o<t<t 



sup E^ r {{f^,l) r } 



x 1 1 exp{(t - s)£(9)} - l\ lr {\9\ a V \9\ ar )s 
+ (l-exp{-4r(t-s)jf |^|°T((te)| 



1/2 



1/r 



< 



x((ierv|^r)(*-^)) 1/2 

C(r ' a ' l|r|l) sup #/"{</Cl> r } 

n 0<r<T 

x{(icv|0r)(i^riinieii+i)(t- s )} 1/r . 

Furthermore, using the last two claims of Proposition 2 and (21), we find 
that the branching part of uf(9) satisfies 

E l l r {\u n t \9)-u^ b {9)\ 2r } 
c(r) 



< \exp{{t-s)e{9)}-l\ 2r 

[s/s] 



n 



x E 



n r E< 



'£ exp(2(te- S ) / |^rr(^))(^ E _,C, 
I Js dl J 

5^ exp|2(fce-s) J \9'z\ a T{d; 



x(\\[M n (9)] kE \\-E u {\\[M n (9)]k, 



ke\ 
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(32) 



+ exp|-2ri J \6'z\ a T(dz)^ 

exp hk \e'z\ a T(dz) \{^ e -,Q 

k =[ s /e\+l L JSd i J 

e\ expUke f \6'z\ a T{dz)X 

[ fc=U/e|+l ^ JSd l ' 



x E< 



x(\\[M n (e)] k£ \\-E u {\\[M n (9)} k£ \ 



< 



c^di^iioovir/ 2 



x |exp{(i- S )^)}-l| 



2r 



x E< 



E 



[s/e] 
k=l 

Ltej 

fc=Ls/eJ+l 



+ e 



(1-0/2 



sup 

0<t<T 



+ e 



1/2, 





t 




s 


) 


( 


_e_ 




_£_ 





r/2 ) 1 / r 

sup E{{tf,l) r }\ . 

0<t<T 
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1/r 



Using Jensen's inequality applied to normalized sums and Lemma 3, we find 
from (32) that 

E 1 / r {\u^\e)-u^ b (9)\ 2r } 

cWWh'hWn V ir/ 2 SU Po<T<T ^ {(/U n, l)r } 



< 



x i|exp{(t-s)^)}-l| 2r (e r / 2 



r-l 



+ e 



(l-r)/2 



(33) 



E r ' 2 ( 


t 




s 




t 




S 


y/2|l/r 




_e_ 




_£_ 


_£_ 




_£_ 





< 



; (r,a,||r||)(||^/ t || oo Vir/ 2 S u P0 < T < r ^ 1 / r {<^,l) r } 
e 1 l 2 n 
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2 



x ^/( 2r )(l A {\6\ a \ln\6\\{t - s)}) 

(r-l)/r 





t 




S 


) 


( 


_£_ 




_£_ 





+ e 



(r+l)/(2r) 









S 


n 


( 


_£_ 




_£_ 





Piecing together (31), (33) and Lemma 9, one has that 

E^{\u n t {6)-u n s (9)\ 2r } 

c(r,H ) a ) ||r||,T)(||/i / / l || 0O Vl) 3r / 2 



(34) 



< 



x \ e l/{2r) (\9\ a/r V \9\ a ^ r+2 ^ r )(t - s) 1/r 

(r-l)/r 





i 




S 


) 


( 


_£_ 




_£_ 





+ £ 



(r+l)/(2r) 



1/2 



Then, using Minkowski's integral inequality and (34), we find that 

#/(*){||ti?-fl?||^ (7) } 

\ 1/2 

c(r,H,di,a, ||r||, WtihWo^T) 



< 



(35) 



< 



£ l/4 n l/2 
x J e l/(4r) (t _ a) l/(2r) +e l/ 3| 





f 




S 


) 


( 


_£_ 




_£_ 





(r-l)/(2r) 



+ £ 



(r+l)/(4r) 



( 






S 






_£_ 




_£_ 





Moreover, we find from (35) that 
(36) 



sup E^)m\\l ■ } <^M\T\\,\\h'h\UT) 

0<t<T { ' 



£ 



(r-l)/(4r) n l/2 



(b) Estimation of A<i- 

In the sequel, we use * to denote the convolution of functions. By our 
assumption that h G S(]R dl ), one finds that q% G S(R dl ) for k G N. We define 
the function 

ij) T {6) = exp{£(0)r} V9eR dl ,T£R 

and the operators 

A k f = (l + B k )f, B k f = el*f, 
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(37) 



g%(9) = / e- (x)gF k (x)dx, k G N, 



/ i / Lt/eJ_1 \ 

\fc=|"s/e]+l / 



T t ,sf = i>t-\t/e\eA\t/E\ II bl>s A k}\i>(\sJe-\+l)s-sf 

\fc=|"s/e]+l / 

for / G L 2 (M dl ; ~f(d9)), with the interpretations that the products go from 
right to left as one goes from the bottom. We find by (22) and (24)-(27) 
that 

W)= [\i(e) + (DY 9 e *W-)W))d*+ f(DY!*u^_){e)ds. 
Jo Jo 



Hence, v^(9) is given by 
(38) 



lt/e\ 

fc=i 



Moreover, we find for < s < t < T that 

Kid) - v n s {9)\ < |(T M - 1h-,)vW)\ + m-s - 1)W)| 
[t/ej 



(39) 



+ 



E r^Jfit-W 

fc=Ls/eJ+l 



Yet, recalling (37) and defining 
(40) flJ(9) = ^ l M £ T {l _ 1)£ J(9) VZ = 

we see that, for any 9 G R dl , < s < T, 

L*AJ 

(r t ,.-v^.)fi?(fl)= E 

and for any 6> G R dl , < it < v < T, 

L«AJ 

E TlfMe^O) 
k=[u/e\+l 



+ 1,..., 
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are sums of, respectively, forward martingale and backward martingale dif- 
ferences. Thus, we find that 



(41) 



(42) E< 



[t/e\ 

E{\(Tt, s -i>t-sK(o)\ 2 }= e E{\fixm 2 h 

i=Ls/eJ + l 

2~ 



[v/e\ 

E T^utUO) 

k=[u/e]+l 



[v/ej 

= E E{\T t { 

) k= \u/e\+l 



^-Wi- 



fe u ks 



E 



For w € R 1 , we define 

mro (.) = ( l + |.|2)-T/2 (1 + |. +ro |2 )T /2_ 

Then, by Minkowski's integral inequality, classical multiplier theorem (see [18], 
page 96, Theorem 3), Jensen's inequality, independence, the assumption 
on h, (11) and Lemma 3, we find that 

E{\\Bif\\h {1) } = E {J udi \J Rdi Qti^w - + m 2 r /2 dw^de} 

< E{ (J^ \gf(zu)\ • ||/ • (1 + | • +™\ 2 y/ 2 \\ L i dm} 2 } 
\Q £ l (m)\-\\m VJ -f-(l + \-\y/ 2 \\ L 2 dvc 

(43) <c(di)i|(jT d |£f(tzO|(l + M 2 ) [dl/2]+1 - 7/2 (fe7 

< c(di)i?{||(l + I • \ 2 ) i[dl - 2l]+2)/2 gf\\ 2 L 2 • ||/|||2 (7) } 
<c(di)E{|||^|||f dl _ 27]+2 }E{||/||| 2(7) } 

< c(d!, «/i» I< i 1 _ 2T ]+2)e^{||/||i aCT) } 
for any / € L 2 (Cl, , L 2 (R dl ; j(d9))), where 

i-2 7 ]+2=( E \\ DT S e i \\h ) 

\b-|<[di-27]+2 / 



2 

L=( 7 ) 



\Ql \\\{d-L 



\ 1/2 



is the standard Sobolev 27 ] +2,2 -norm of gj. Moreover, using (40), the 

fact that \ip e (6) \ < 1, independence, (43) and recursion, we find that 

max E 1/2 {\\T},%\\l> M } 

[s/e\+l<l<\t/e\ ' L (/) 

-, / ,??5£u/ l ( c ( d i'(( /l ))Mi-2 7 ]+ 2 )^{||r a „ 1)ei Xlli2 (7) }) 1/2 

Ls/£j+l<(<Lt/eJ 
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Ls / £ j + Tf< L t/^ C((il ' <</l))[dl "^ +2)£ 



X 



1/2 



< max 

\s/e\+X<l<\t/e\ 



E{\ip £ T {l _ 2)£jS v^ 

+ \B l ^ £ T^ 2)£iS v^e)\ 2 h(d0) 

(c(di, ((h)) [dl _ 2y]+2 )£(l + c(di, ((/i)) [(il _2 7 ] + 2)e 



x^{||T (I _ 2)e Xlli=»( 7 )}) 
(44) < max ( c ( d i 5 ((M>[di-2 7 ]+2)e(l + c ( d i> (( /l ))[d 1 -2 7 ]+2)e)'" 1 



1/2 



x^{|K||| 2(7) }) 



,1/2 



<C 



Now, in a similar manner to (44), we find from (36) with r = 2 and Jensen's 
inequality that 

>/£U„ || 2 



(45) 



, /, + T< a f<, ,,^11^^-11^(7)} 

lu/e\+l<k<[v/ej K ' 

< C (d 1 ,((/ l )) [(il „ 27]+2 ) e 1 /2 j El/2 { ||^ || 2 2w} 

c(H,di,a,||r||,((/i)) [dl _ 27]+2 ,r)e 3 / 8 



< 



n 



1/2 



Hence, combining (42), (45) and (38), we find that 
E 1 ' 2 . 



\t/e\ 2 
1 t,ke U ke 



(46) 



k=[s/ei+l 



L2( 7 ). 



< 



c(S,di,a, ||r||,((/i)) [dl _ 27]+2 ,T)e 3 / 8 



7? 



1/2 



(47) ^/ 2 {||^||i 2(7) } 



< 



■( 


f 






) 




_e_ 








27] 


+2 


T) 





1/2 



£ l/8 n l/2 

Replacing -y(d6) with (\6\ a ln\0\) 2 j(d9), noting that 7 < -(di/2 + 2a) by the 
assumption and repeating the above arguments, one finds that 



(48) 



>Hn|0|) 2 K| 2 (0) 7 (d0) 
c(S,di,a, ||r||,((/i))[ dl _2 7 ] + 2,r) 



< 



£ l/8 n l/2 
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Now, it follows by (41), (44) and (??) that 

EV^\\(T t>s -^ s )v s f L2(j) } 

(H,di )Q;) ||r||,((h)) [(il _ 27]+2 ,T) e 3 / 8 



(49) 



< 



n 



1/2 





t 




s 


) 


( 


_e_ 




_e_ 





1/2 



Finally, using the bound \ip t - s {9) - 1| 2 < c(a, ||r||)(|0| a In \9\) 2 \t - s\ 2 , (39), 
(46), (48) and (49), one finds that 



E 1/2 m-v?\\h M } 



(50) 



< 



;(5,di,a, ||r||, {(h)) [dl _ 2 -y]+2, T ) 



£ l/8 n l/2 



x{(i- S ) + £ 1/2 ( 



1/2 



(c) Estimation of A3. 

Note that the solution x" (#) defined by (26) and (25) can be written as 

[t/e] 

xU8)=A-[t/e}e II {4^}(Mo -»o,e-e) 

k=l 



and 

(51) ^{K^-z^e^)! 2 }^ 
Then, one finds similarly to (50) that 



nV2 



(52) 



E 1/2 {\\x?-mh h) } 

c(S,di,a J ||r|| J ((h)) [dl _ 27]+2 ,r)e 1 /2 



< 



x {(*-«) + ( 



nV2 




t 




S 


_£_ 




e 



1/2 



Therefore, (12) follows from (28), (35) with r = 2, Jensen's inequality, (50) 
and (52). By virtue of (51), (13) is an immediate consequence of (12) by 
letting E = e 1/2 . □ 

3.3. Proof of Corollary 5. Since a = 2, we find by (30) and (18) that 

E i / r {\ur(o)-urm 2r } 

sup E^On^iy} 

n 0<t<T 
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(53) 



x j(expj-(t-s)^ \e'z\ 2 T(dz)^ - 1 

x ( [ S exp{-2(s-T) [ \9'z\ 2 T(dz)\d(T [ \6'z\ 2 Y{dz) 
\Jo I JS dl J V JS dl 

+ (^exp{-2(i-r)^ |^| 2 r(^)|d(r^ \e'z\ 2 T(dz^j J } 
<£^ sup ^ 1 /r{^ il yr|/ 1 _ exp f_ 2(t _ s) /" |^p r / d 

" 0<r<T V I J5 dl 



r\ 1/r 



< 



sup E x l r {{i%,lY}(t-a)\0\*. 



n 0<r<T 

Replacing (31) with (53), we find similarly to (35) that 

c(r, HrllJ/i'/ilUT) 



#/<*>{||<i?-fi?||& (7) } 



< 



e l/4 n l/2 
x J £ l/(4r) (t _ s) l/2 +£ l/2 





i 




S 


( 


_£_ 




_£_ 



(r-l)/(2r) 



+ e 



(r+l)/(4r) 







s 













Letting r = 2, we then find that, for ft > 1/8, 



< 



c(H,di, ||r||, H/i'/illocT) 



err 



< 



x| e l/2 ( i_ s) 2 + £ 

c^diJiriMi^n^r) 



3/2 



en 1 



+ e 



x (l/2)+4/3 



+ e 



3/2 | 









S 


yi/2)+4/3| 


( 











Thus, by Lemma 10, we find that 
E x l 2 \ 



(54) 



sup \K - u n s \\ 2 L 2 {) 

lO<s<t<T 



cCH.di.AHriui^Hoo.T) 



sup |K-u?||ia (7) 



< 



£ /3 n l/2 
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Similarly, by (50), (52) and Lemma 10, we find that 

.mi 2 \ ^ c (Z,di,[3,\\r\\,{{h)) [dl _ H+2 ,T) 



(55) E l ' 2 { sup ||C-fi?||! 2(7 )}< 



£ /3 n l/2 



and 

c(H,di,/3, ||r||,((/i)) [dl _ 27]+2 ,T) 



(56) sup ||tf-*?|k (7) }< 



Therefore, (14) follows from (28), (54), (55) and (56). By virtue of (51), (15) 
is an immediate consequence of (14) by letting E = e 1/2 . □ 

APPENDIX: PROOFS OF LEMMA 1, PROPOSITION 2 AND 

LEMMA 3 

In the current section we give the proofs of Lemma 1, Proposition 2 and 
Lemma 3. We realize that similar results are well known in a variety of 
settings and only give them for the sake of completeness. 

Proof of Lemma 1. For ip e T, we have that 

<p(Xt)-<p(X )= f £<p(X s )ds + M t (<p), 
Jo 

where Mt(f) 1S an Af*-martingale. Then, 

<p(X t )rk 1 = <p(X ) + f t C^X s )r ] J 1 ds+ f \~} dM s {ip) 



L*/eJ / f 

+ E <P{X tk )r^ 1 - exp -(Y tk - Y^)' h(X tk ] 
k=i v 

{tk-tk.^ih'h^X^ 



+ 

By the independence of X and Y under P, we find that J\A t ((p) is also an 
X* V ^-martingale so E{$ rjjl dMsif)^} = 0- Hence, 

(57) J " 

+ E (^,^(l - exp{-(r„ - Y. t _,)'ft + (tt - t " 2 - l)h ' h 

On the other hand, we obtain from the definition of fit and the stochas- 
tic continuity of X that, for any continuous bounded function ip on R rfl , 
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and k > 1 , 



Ht h M 1-exp^ -{Y tk - Y tk _ 1 )'h + 



(t fe - t fc _i)/i'/i 



E x {<p(X tk )[expi (Y tk -Y t 



: tfc 



ite) _(t-yww|. 1 j 



(58) 



(tfc -t k - X )h'h 



(t k -t k -x)tih 



where £^ is the expectation taken only with respect to X. Further, (58) holds 
for any <p 6 £>;,(IR dl ) by the monotone class theorem. Substituting (58) into (57), 
we get (4). 

The uniqueness of \xt can be proved by the action of £ on the trigonometric 
polynomials and induction. In fact, suppose that {nt,t > 0} and {vt,t > 0} 
satisfy (4), and fit = v t for t < t k for some k > 0. Note that 



y |^| Q ^l+isign(^)tan^^r((iz)^e_ e , fora/1, 



2t 



|0'z| 1 sign(#'z) In |0'z| T(dz) e_ e 



7T 



for a = 1. 



From (4), one finds that, for any 9 G t k <t < ifc+i, 
(/•**> e_e) 



(jH h , e_ e ) exp{-(i - y |^z| Q (l + » sign(^z) tan(^) ) r(tfe) J 



for a^l, 



K , e_ e ) exp|-(i - t fc ) y (l - ^ sign(fl'z) In \9'z^j r(cfe)}, 



for a = 1 
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Since the set of trigonometric polynomials is measure-determining, fit = 
vti tk < t < ifc+i. Hence, by (4), we find that = u t k+1 - Therefore, the 

uniqueness of fit follows by induction. □ 



Proof of Lemma 3. Let W be a standard R 2 -valued Brownian motion 
on (n,F,P). We fix an x € R dl and define 

Then, 

s{iei(x)r}=s{|zf-in 

for any k £ N. By Burkholder's, Minkowski's integral and Jensen's inequal- 
ities, we find that, for any < t < e, 

E{\Zf-l\ r }<c(r)\\h%\\^E^j\zf)^sJ /2 ^ 

< C (r)||^||^ 2 ^|(^(Zf-l) 2 d s y /2 }+ £ '-/ 2 ) 
<c(r)||/ t 'h||^ 2 ((^{|^-ir}) 2 Ad s y /2 + e'-/ 2 ) 

< c(r) || (e^ 2 )" 1 jf ' - in ds + e^ 2 ) , 

where we have assumed without loss of generality that r > 2 above. Applying 
Gronwall's inequality, one then discovers that 

sup E{\Z?-l\'}<c(r)\\h'hU 2 6r/ 2 

0<t<e 

and the lemma follows. □ 

Proof of Proposition 2. To ease the notation in the sequel, we let 
£fc = £f • F° r f e T , we define 

iLtAjK"/ . . r t k+1 M \ 

aw = -EE (vC^xa*) - - / A« n ) ** ) 

n fc=0 i=l v y 

(59) +-E E (V' V > 

n fc=l i=l tfc - 

x (sign(^(^; n _))i {c/I , fcg[0i|?fe(xr _ )|)} -£ fc (A^; n _)). 



RATES FOR PARTICLE APPROXIMATIONS OF FILTERS 



31 



Then, we find from our algorithm and (1) that (6) holds. Recalling that 
the {U l,k } are independent and compensating the square of the jumps in the 
second term of (59), we find that {M r t l ((p)}t>o is a cadlag {<5*}t>o-martingale 
satisfying (7). 

Now, turning to bounding the difference between the quadratic variation 
[M n (ip)]t and the expected quadratic variation E u {[M n (ip)]t} , we define 



A i,k 



n 



{5 x i, n _ , if) (sign {Xl' k n _ ))l {[/i , fc6 [m {x 



tu- 



rn 



Letting {fk}kL± C M, recognizing the martingale transform and using Burkholder's 
and Jensen's inequalities, we bound 



[t/e\ 

E fk([M n (v)}ke-E u {[M n &)} ke }) 

k=[s/e\+l 



E 



\t/e\ 



E /*(( E Ahk 

k=[s/ei+l 



E 



E * 



i=l 



(60) < c(r)E< 
< <r) I 



E A 2 (( E ^ 

fc=Ls/eJ+l 



E ^ 



i=l 



i=l 



r/2- 



L*AJ 



(r/2)-l 



E ^ 



\fc=Ls/£j+l 

L*/eJ 

x E a 2 ^ 

fc=Ls/eJ+l 



E ^ 



11/41.- II x 2< 



E a 



i=l 



i=l 



However, defining the nitrations {^ l + }^' =1 and {^^"l}^! via 

J™ + = 0**- v a{TP' k , i < m}, = Cf*~ V a{U^ k , i > m}, 

we find that 



m 



E^ 

u=l 



i,k 



E 



V 



E^' fc 



\i=l 



is an {jF™ + }^ =1 -martingale and m — > A l ' k J2)= m ^' k is a backward 
{jF™_}^ =1 -martingale for each i. This means we can again apply Burkholder's, 
Jensen's and 2ab < a 2 + b 2 inequalities and use the independence of {U l,k } 
to find that 



E 



E * 



i,k 



E L 



E * 



i,k 



i=l 



i=l 
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IK- II 



<<r)M 



n II (r/2) — 1 



J2 El \(A i ' k ) 2 - E u {(A^ k ) 2 }\ r 



i=l 



+ 



i-1 



gt k - 



(61) <c{r)\\nl_ 



rr-2 



^ ( £{|(yf' fc ) 2 - E u {(A^ k ) 2 }\ r \g tk ~} 



i=l \ 



i-1 



+ Y,E{\A i ' k A i > k \ r \g t "-} 



3=1 



IK 



< c(r 



n mi — 2 
fc— II 



2 i J B t/ {i(A i ' fe ) 2 - J E c/ {(^' fc ) 2 }r} 



i=l 



+ (i-l)(^{(^' fe ) 2 }) r 

i-1 

+ ^(iF{|(^'' fc ) 2 - ^{(AJ'*) 2 }| r } 

i=i 



+ (E u {(A>' k ) 2 })^ 



\K 



<c(r)|K 



„,i r " 1 ^ ( J B c/ {|(A i ' fc ) 2 - J E c/ {(^ fc ) 2 }r} 

1 

n[7 rv / tj,fc\2T\r 



+ ( J E t7 {(^'^}) r ), p _ ag 



Now, Hm^-II =n(/x" fe _,l) and it follows by direct calculation of E u {\(A hk ) 2 ■ 
E u {(A i > k ) 2 }\ r } that 



IK, 



EUn^^r 1 J2 \{A**) 2 -EP{{A») 2 }\' 
I i=i 



1 



^^( M «_,ir i (^_,i^{ii-3ie fc i+2^rie 



i2d-iGkir(i-iGki)» 
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Next, conditioning on cr{/i™ fc _}, using the independence of the increments of 
Y and Lemma 3, we find that 



Wn<M? fc -,l>) r_1 E \(A i ' k ) 2 -E u {(A i ' k ) 2 }\ r 

(62) 



i=l 



By Lemma 3 and the fact that 

{ EU {iA i, k) 2 }) r = m _ f k y n -2r^r {xl ,n_^ 

we find that 



K-ii 



E\(n(^ k _,l)Y- 1 E {E U {{A^ k f}) 
(63) 

c(r) \\h'b§J?e r /* ~ n r 2r 



< — n r — ^K-.iniML- 



Then, substituting (62) and (63) into (61) and (60), we find that 



E h([M n (<p)] ke -E u {[M n (<p)] ke }) 

k=ls/e\+l 



( L*AJ \ r / 2 r i /2/ x 

V fc=L ^j +1 / nT \0<r<T ) 

for some constant c(r) > independent of di, efe, e, n, t, s, (p. □ 
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